Pressure sensitive multi-layer passwords

ABSTRACT

A method of authenticating a user of a computing device is proposed, together with a computer readable medium and a computing device on which the method is implemented. In the method a modified base image is overlaid with a modified overlay image on a display and either the modified base image or modified overlay image is moved by the user. Positive authentication is indicated in response to alignment of a base image reference point and an overlay image reference point and an indication of a correct level of pressure applied to a pressure sensitive input device.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is related to commonly owned U.S. applicationsSer. Nos. 12/969,647 entitled “ADJUSTING THE POSITION OF AN ENDPOINTREFERENCE FOR INCREASING SECURITY DURING DEVICE LOG-ON”; 12/969,878entitled “VISUAL OR TOUCHSCREEN PASSWORD ENTRY”; 12/969,797 entitled“OBSCURING VISUAL LOGIN”; 12/969,645 entitled “MULTI-LAYERORIENTATION-CHANGING PASSWORDS”; 12/969,643 entitled “MULTI-LAYERMULTI-POINT OR PATHWAY-BASED PASSWORDS”; 12/969,640 entitled“MULTI-LAYERED COLOR-SENSITIVE PASSWORDS”; 12/969,638 entitled “SIMPLEALGEBRAIC AND MULTI-LAYER PASSWORDS”; 12/969,637 entitled “MULTI-LAYERMULTI-POINT OR RANDOMIZED PASSWORDS”; 12/969,633 entitled “PASSWORDENTRY USING 3D IMAGE WITH SPATIAL ALIGNMENT”; and 12/969,629 entitled“PASSWORD ENTRY USING MOVING IMAGES”; all of which were filed on thesame date as this application and are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates generally to graphical authentication.

BACKGROUND

Passwords may be used in many situations where a user needs to beauthenticated. Situations requiring authentication may include theability to access or use a computer, mobile phone, PDA, or any otherdevice. They may also enable access to a physical location, or allow useof a credit/debit card or similar instrument. Passwords are typicallyalpha-numeric strings or sequences entered on a keyboard. Graphicalauthentication systems, where passwords are comprised of graphicalcomponents, also exist.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a communication system includinga mobile communication device in which example embodiments of thepresent disclosure can be applied;

FIG. 2 is a block diagram illustrating a mobile communication device inaccordance with one example embodiment of the present disclosure;

FIG. 3 is a block diagram illustrating an authentication module inaccordance with one example embodiment of the present disclosure;

FIGS. 4 a and 4 b are flowcharts illustrating a method in accordancewith one example embodiment of the present disclosure;

FIG. 5 is a screen shot illustrating one example embodiment of thepresent disclosure;

FIG. 6 is a block diagram illustrating a computing device in accordancewith one example embodiment of the present disclosure;

FIG. 7 a is a block diagram illustrating a computing device inaccordance with one example embodiment of the present disclosure;

FIG. 7 b is a block diagram illustrating a computing device inaccordance with one example embodiment of the present disclosure; and

FIGS. 8 a to 8 d are screen shots illustrating one example embodiment ofthe present disclosure.

Like reference numerals are used in the drawings to denote like elementsand features.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

In some graphical authentication systems, a user must move a previouslyselected reference point on an overlay image, such as a grid, to apreviously selected reference point on a base image. With existinggraphical authentication systems, “shoulder surfing” can occur. Forexample, a third party observer may be able to determine where a cursoris located at the end of the authentication process. In some situations,a third party observer may observe where the user's fingers arepointing. In other situations, a computer algorithm could be used todetermine a pattern of where certain points on the overlay image arelocated at the end of the authentication process.

The present application proposes adding a pressure sensitive element tothe entry of the passcode. For example, in order to get one or both ofthe images to appear, a touchscreen or a touch pad must be pressed untila correct pressure level is reached. Another example embodiment requiresthat the correct amount of pressure be applied once the two referencepoints are aligned in order to have positive authentication. In somecases, an amount of pressure controls a variable, such as ability tomove an image, a speed of movement or a speed of a video image. In someembodiments, the speed of release of pressure is an additional variable.For example, a steady pressure is required to move the overlay image andfast release is a trigger to indicate that movement is complete. Slowrelease could indicate that the user intends to move the image further.

In one aspect, there is provided one or more computer readable mediahaving computer readable instructions stored thereon that when executedby a processor implement a method of authenticating a user of acomputing device, the computing device having a memory storing a baseimage and an overlay image, the base image having a pre-selected baseimage reference point, and the overlay image having a pre-selectedoverlay image reference point, the method comprising: generating amodified base image; generating a modified overlay image; displaying, ona display, the modified base image overlaid by the modified overlayimage; receiving a first input for moving one of the modified base imageand the modified overlay image; moving the one of the modified baseimage and the modified overlay image in response to the input; receivinga second input indicative of pressure applied to a pressure sensitiveinput device; and in response to alignment of the base image referencepoint on the modified base image with the overlay image reference pointon the modified overlay image at a point on the display and to saidsecond input meeting a pressure criterion, indicating positiveauthentication.

In another aspect, there is provided a method of authenticating a userof a computing device, the computing device having a memory storing abase image and an overlay image, the base image having a pre-selectedbase image reference point, and the overlay image having a pre-selectedoverlay image reference point, the method comprising: generating amodified base image; generating a modified overlay image; displaying, ona display, the modified base image overlaid by the modified overlayimage; receiving a first input for moving one of the modified base imageand the modified overlay image; moving the one of the modified baseimage and the modified overlay image in response to the input; receivinga second input indicative of pressure applied to a pressure sensitiveinput device; and in response to alignment of the base image referencepoint on the modified base image with the overlay image reference pointon the modified overlay image at a point on the display and to saidsecond input meeting a pressure criterion.

In another aspect, there is provided a computing device comprising: aprocessor; a display; and one or more computer readable media havingcomputer readable instructions stored thereon that when executed by theprocessor implement a method of authenticating a user of the computingdevice, the computing device having a memory storing a base image and anoverlay image, the base image having a pre-selected base image referencepoint, and the overlay image having a pre-selected overlay imagereference point, the method including generating a modified base image;generating a modified overlay image; displaying, on a display, themodified base image overlaid by the modified overlay image; receiving afirst input for moving one of the modified base image and the modifiedoverlay image; moving the one of the modified base image and themodified overlay image in response to the input; receiving a secondinput indicative of pressure applied to a pressure sensitive inputdevice; and in response to alignment of the base image reference pointon the modified base image with the overlay image reference point on themodified overlay image at a point on the display and to said secondinput meeting a pressure criterion, indicating positive authentication.

Embodiments of the present application are not limited to any particularoperating system, mobile device architecture, server architecture, orcomputer programming language.

Reference is first made to FIG. 1 which shows in block diagram form acommunication system 100 in which example embodiments of the presentdisclosure can be applied. The communication system 100 comprises anumber of mobile communication devices (mobile devices) 201 which may beconnected to the remainder of system 100 in any of several differentways. Accordingly, several instances of mobile communication devices 201are depicted in FIG. 1 employing different example ways of connecting tosystem 100. Mobile communication devices 201 are connected to a wirelesscommunication network 101 which may comprise one or more of a WirelessWide Area Network (WWAN) 102 and a Wireless Local Area Network (WLAN)104 or other suitable network arrangements. In some embodiments, themobile communication devices 201 are configured to communicate over boththe WWAN 102 and WLAN 104, and to roam between these networks. In someembodiments, the wireless network 101 may comprise multiple WWANs 102and WLANs 104.

The WWAN 102 may be implemented as any suitable wireless access networktechnology. By way of example, but not limitation, the WWAN 102 may beimplemented as a wireless network that includes a number of transceiverbase stations 108 (one of which is shown in FIG. 1) where each of thebase stations 108 provides wireless Radio Frequency (RF) coverage to acorresponding area or cell. The WWAN 102 is typically operated by amobile network service provider that provides subscription packages tousers of the mobile communication devices 201. In some embodiments, theWWAN 102 conforms to one or more of the following wireless networktypes: Mobitex Radio Network, DataTAC, GSM (Global System for MobileCommunication), GPRS (General Packet Radio System), TDMA (Time DivisionMultiple Access), CDMA (Code Division Multiple Access), CDPD (CellularDigital Packet Data), iDEN (integrated Digital Enhanced Network), EvDO(Evolution-Data Optimized) CDMA2000, EDGE (Enhanced Data rates for GSMEvolution), UMTS (Universal Mobile Telecommunication Systems), HSDPA(High-Speed Downlink Packet Access), IEEE 802.16e (also referred to asWorldwide Interoperability for Microwave Access or “WiMAX), or variousother networks. Although WWAN 102 is described as a “Wide-Area” network,that term is intended herein also to incorporate wireless MetropolitanArea Networks (WMAN) and other similar technologies for providingcoordinated service wirelessly over an area larger than that covered bytypical WLANs.

The WWAN 102 may further comprise a wireless network gateway 110 whichconnects the mobile communication devices 201 to transport facilities112, and through the transport facilities 112 to a wireless connectorsystem 120. Transport facilities may include one or more privatenetworks or lines, the public internet, a virtual private network, orany other suitable network. The wireless connector system 120 may beoperated, for example, by an organization or enterprise such as acorporation, university, or governmental department, which allows accessto a network 124 such as an internal or enterprise network and itsresources, or the wireless connector system 120, may be operated by amobile network provider. In some embodiments, the network 124 may berealised using the Internet rather than an internal or enterprisenetwork.

The wireless network gateway 110 provides an interface between thewireless connector system 120 and the WWAN 102, which facilitatescommunication between the mobile communication devices 201 and otherdevices (not shown) connected, directly or indirectly, to the WWAN 102.Accordingly, communications sent via the mobile communication devices201 are transported via the WWAN 102 and the wireless network gateway110 through transport facilities 112 to the wireless connector system120. Communications sent from the wireless connector system 120 arereceived by the wireless network gateway 110 and transported via theWWAN 102 to the mobile communication devices 201.

The WLAN 104 comprises a wireless network which, in some embodiments,conforms to IEEE 802.11x standards (sometimes referred to as Wi-Fi) suchas, for example, the IEEE 802.11a, 802.11b and/or 802.11 g standard.Other communication protocols may be used for the WLAN 104 in otherembodiments such as, for example, IEEE 802.11n, IEEE 802.16e (alsoreferred to as Worldwide Interoperability for Microwave Access or“WiMAX”), or IEEE 802.20 (also referred to as Mobile Wireless BroadbandAccess). The WLAN 104 includes one or more wireless RF Access Points(AP) 114 (one of which is shown in FIG. 1) that collectively provide aWLAN coverage area.

The WLAN 104 may be a personal network of the user, an enterprisenetwork, or a hotspot offered by an internet service provider (ISP), amobile network provider, or a property owner in a public or semi-publicarea, for example. The access points 114 are connected to an accesspoint (AP) interface 116 which may connect to the wireless connectorsystem 120 directly (for example, if the access point 114 is part of anenterprise WLAN 104 in which the wireless connector system 120 resides),or indirectly via the transport facilities 112 if the access point 114is a personal Wi-Fi network or Wi-Fi hotspot (in which case a mechanismfor securely connecting to the wireless connector system 120, such as avirtual private network (VPN), may be appropriate). The AP interface 116provides translation and routing services between the access points 114and the wireless connector system 120 to facilitate communication,directly or indirectly, with the wireless connector system 120.

The wireless connector system 120 may be implemented as one or moreservers, and is typically located behind a firewall 113. The wirelessconnector system 120 manages communications, including email messages,to and from a set of managed mobile communication devices 201. Thewireless connector system 120 also provides administrative control andmanagement capabilities over users and mobile communication devices 201which may connect to the wireless connector system 120.

The wireless connector system 120 allows the mobile communicationdevices 201 to access the network 124 and connected resources andservices such as a messaging server 132 (for example, a MicrosoftExchange™, IBM Lotus Domino™, or Novell GroupWise™ email messagingserver) having a global address book 134, and optionally other servers142. The other servers 142 may comprise a content server for providingcontent such as internet content or content from an organization'sinternal servers to the mobile communication devices 201 in the wirelessnetwork 101, and an application server for implementing server-basedapplications.

The global address book 134 comprises electronic contact recordsgenerated and maintained by an IT (information technology) administratorof the network 124. Typically, the global address book is maintainedexclusively by the messaging server 132 and there is no local copy onthe mobile device 201. In addition, the global address book typicallycomprises contact records for all users of the respective network 124(e.g., enterprise). The contact records in the global address book 134may be one or more of individual contact records (or user records) or agroup address or distribution list which lists multiple individual(users).

The wireless connector system 120 typically provides a secure exchangeof data (e.g., email messages, personal information manager (PIM) data,and IM data) with the mobile communication devices 201. In someembodiments, communications between the wireless connector system 120and the mobile communication devices 201 are encrypted. In someembodiments, communications are encrypted using a symmetric encryptionkey implemented using Advanced Encryption Standard (AES) or Triple DataEncryption Standard (Triple DES) encryption. Private encryption keys aregenerated in a secure, two-way authenticated environment and are usedfor both encryption and decryption of data.

The wireless network gateway 110 is adapted to send data packetsreceived from the mobile device 201 over the WWAN 102 to the wirelessconnector system 120. The wireless connector system 120 then sends thedata packets to the appropriate connection point such as the messagingserver 132, content server or application server 136. Conversely, thewireless connector system 120 sends data packets received, for example,from the messaging server 132 or other server 142 to the wirelessnetwork gateway 110 which then transmit the data packets to thedestination mobile device 201. The AP interfaces 116 of the WLAN 104provide similar sending functions between the mobile device 201, thewireless connector system 120 and network connection point such as themessaging server 132, content server and application server 136.

The network 124 may comprise a private local area network, metropolitanarea network, wide area network, the public internet or combinationsthereof and may include virtual networks constructed using any of these,alone, or in combination. Computers 117 may be connected to the network124 directly or indirectly via an intermediate communication networksuch as the Internet. When computers 117 connect to the networkindirectly, e.g. via the Internet, a VPN or other mechanism for securelyconnecting to the network 124 may be appropriate. Computers 117 may beof any suitable construction and include at least a processor, and adisplay screen, one or more user input devices, and a memory eachconnected to the processor as is known in the art. The computers 117could be desktop computers, laptop/notebook/netbook computers, orcombinations thereof, and may have wired or wireless communicationsubsystems for connecting to the network 124.

A mobile device 201 may alternatively connect to the wireless connectorsystem 120 using a computer 117 via the network 124. In at least someembodiments, for security purposes the computers 117 with which themobile devices 201 can connect to the wireless connector system 120 arelimited to computers 117 which are directly connected to the network124. A link 106 may be provided for exchanging information between themobile device 201 and computer 117 connected to the wireless connectorsystem 120. The link 106 may comprise one or both of a physicalinterface and short-range wireless communication interface. The physicalinterface may comprise one or combinations of an Ethernet connection,Universal Serial Bus (USB) connection, Firewire™ (also known as an IEEE1394 interface) connection, or other serial data connection, viarespective ports or interfaces of the mobile device 201 and computer117. The short-range wireless communication interface may be a personalarea network (PAN) interface. A personal area network is a wirelesspoint-to-point connection meaning no physical cables are required toconnect the two end points.

It will be appreciated that the above-described communication system isprovided for the purpose of illustration only, and that theabove-described communication system comprises one possiblecommunication network configuration of a multitude of possibleconfigurations for use with the mobile communication devices 201. Theteachings of the present disclosure may be employed in connection withany other type of network and associated devices that are effective inimplementing or facilitating wireless communication. Suitable variationsof the communication system will be understood to a person of skill inthe art and are intended to fall within the scope of the presentdisclosure.

Reference is now made to FIG. 2 which illustrates an exemplaryembodiment of the mobile device 201 in which example embodimentsdescribed in the present disclosure can be applied. The mobile device201 is a two-way communication device having data and voicecommunication capabilities, and the capability to communicate with othercomputer systems, for example, via the Internet. Depending on thefunctionality provided by the mobile device 201, in various embodimentsthe device 201 may be a multiple-mode communication device configuredfor both data and voice communication, a smartphone, a mobile telephoneor a PDA (personal digital assistant) enabled for wirelesscommunication, or a computer system with a wireless modem.

The mobile device 201 includes a rigid case (not shown) housing thecomponents of the device 201. The internal components of the device 201are constructed on a printed circuit board (PCB). The mobile device 201includes a controller comprising at least one processor 240 (such as amicroprocessor) which controls the overall operation of the device 201.The processor 240 interacts with device subsystems such as a wirelesscommunication subsystem 211 (sometimes referred to as a radio layer) forexchanging radio frequency signals with the wireless network 101 toperform communication functions. The processor 240 interacts withadditional device subsystems including a display screen 204 such as aliquid crystal display (LCD) screen, input devices 206 such as akeyboard and control buttons, flash memory 244, random access memory(RAM) 246, read only memory (ROM) 248, auxiliary input/output (I/O)subsystems 250, data port 252 such as serial data port, such as aUniversal Serial Bus (USB) data port, speaker 256, microphone 258,short-range communication subsystem 262, and other device subsystemsgenerally designated as 264. Some of the subsystems shown in FIG. 2perform communication-related functions, whereas other subsystems mayprovide “resident” or on-device functions.

The device 201 may comprise a touch screen display in some embodiments.The touch screen display may be constructed using a touch-sensitiveinput surface connected to an electronic controller and which overlaysthe display screen 204. The touch-sensitive overlay and the electroniccontroller provide a touch-sensitive input device and the processor 240interacts with the touch-sensitive overlay via the electroniccontroller. In some embodiments, a touch screen is integrated directlywith the display. In still other embodiments, a touch screen is placedbehind the display.

The communication subsystem 211 includes a receiver 214, a transmitter216, and associated components, such as one or more antenna elements 218and 220, local oscillators (LOs) 222, and a processing module such as adigital signal processor (DSP) 224. The antenna elements 218 and 220 maybe embedded or internal to the mobile device 201 and a single antennamay be shared by both receiver and transmitter, as is known in the art.As will be apparent to those skilled in the field of communication, theparticular design of the wireless communication subsystem 211 depends onthe wireless network 101 in which mobile device 201 is intended tooperate.

The mobile device 201 may communicate with any one of a plurality offixed transceiver base stations 108 of the wireless network 101 withinits geographic coverage area. The mobile device 201 may send and receivecommunication signals over the wireless network 101 after the requirednetwork registration or activation procedures have been completed.Signals received by the antenna 218 through the wireless network 101 areinput to the receiver 214, which may perform such common receiverfunctions as signal amplification, frequency down conversion, filtering,channel selection, etc., as well as analog-to-digital (A/D) conversion.A/D conversion of a received signal allows more complex communicationfunctions such as demodulation and decoding to be performed in the DSP224. In a similar manner, signals to be transmitted are processed,including modulation and encoding, for example, by the DSP 224. TheseDSP-processed signals are output to the transmitter 216 fordigital-to-analog (D/A) conversion, frequency up conversion, filtering,amplification, and transmission to the wireless network 101 via theantenna 220. The DSP 224 not only processes communication signals, butmay also provide for receiver and transmitter control. For example, thegains applied to communication signals in the receiver 214 and thetransmitter 216 may be adaptively controlled through automatic gaincontrol algorithms implemented in the DSP 224.

The processor 240 operates under stored program control and executessoftware modules 221 stored in memory such as persistent memory, forexample, in the flash memory 244. As illustrated in FIG. 2, the softwaremodules 221 comprise operating system software 223, softwareapplications 225 comprising an email messaging application 272 (alsoreferred to as an email client 272), a personal address book 274, acalendar application 276, a phone application 278, and graphicalauthentication module 280. Example embodiments of the graphicalauthentication module 280 will be discussed in detail later herein. Itis recognized that the graphical authentication module 280 and itsvarious components as described herein can form a discrete modulerunning on the device 201, or the functions of the graphicalauthentication module 280 can be distributed on the device 201 asseparate modules or integrated within other existing modules as desired.Such discrete or distributed implementations all fall within theembodiments of the graphical authentication module 280 as describedherein.

The software applications 225 also may include a range of applications,including, for example, a notepad application, Internet browserapplication, voice communication (i.e. telephony) application, mappingapplication, or a media player application, or any combination thereof.Each of the software applications 225 may include layout informationdefining the placement of particular fields and graphic elements (e.g.text fields, input fields, icons, etc.) in the user interface (i.e. thedisplay screen 204) according to the application.

Those skilled in the art will appreciate that the software modules 221or parts thereof may be temporarily loaded into volatile memory such asthe RAM 246. The RAM 246 is used for storing runtime data variables andother types of data or information, as will be apparent to those skilledin the art. Although specific functions are described for various typesof memory, this is merely one example, and those skilled in the art willappreciate that a different assignment of functions to types of memorycould also be used.

In some embodiments, the auxiliary I/O subsystems 250 may comprise anexternal communication link or interface, for example, an Ethernetconnection. The mobile device 201 may comprise other wirelesscommunication interfaces for communicating with other types of wirelessnetworks, for example, a wireless network such as an orthogonalfrequency division multiplexed (OFDM) network or a GPS (GlobalPositioning System) subsystem comprising a GPS receiver or transceiverfor communicating with a GPS satellite network (not shown). Theauxiliary I/O subsystems 250 may comprise a pointing or navigationalinput device such as a touchpad, a clickable trackball or scroll wheelor thumbwheel, or a vibrator for providing vibratory notifications inresponse to various events on the device 201 such as receipt of anelectronic message or incoming phone call, or for other purposes such ashaptic feedback (touch feedback).

In some embodiments, the mobile device 201 also includes a removablememory card or module 230 (typically comprising flash memory) and amemory card interface 232. Network access is typically associated with asubscriber or user of the mobile device 201 via the memory card 230,which may be a Subscriber Identity Module (SIM) card for use in a GSMnetwork or other type of memory card for use in the relevant wirelessnetwork type. The memory card 230 is inserted in or connected to thememory card interface 232 of the mobile device 201 in order to operatein conjunction with the wireless network 101.

The mobile device 201 also stores other data 227 in an erasablepersistent memory, which in one example embodiment is the flash memory244. In various embodiments, the data 227 includes service datacomprising information required by the mobile device 201 to establishand maintain communication with the wireless network 101. The data 227may also include user application data such as email messages, addressbook and contact information, calendar and schedule information, notepaddocuments, image files, and other commonly stored user informationstored on the mobile device 201 by its user, and other data. The data227 stored in the persistent memory (e.g. flash memory 244) of themobile device 201 may be organized, at least partially, into a number ofdatabases each containing data items of the same data type or associatedwith the same application. For example, email messages, contact records,and task items may be stored in individual databases within the devicememory.

The mobile device 201 also includes a battery 238 as a power source,which is typically one or more rechargeable batteries that may becharged, for example, through charging circuitry coupled to a batteryinterface such as the serial data port 252. The battery 238 provideselectrical power to at least some of the electrical circuitry in themobile device 201, and the battery interface 236 provides a mechanicaland electrical connection for the battery 238. The battery interface 236is coupled to a regulator (not shown) which provides power V+ to thecircuitry of the mobile device 201.

The short-range communication subsystem 262 is an additional optionalcomponent which provides for communication between the mobile device 201and different systems or devices, which need not necessarily be similardevices. For example, the subsystem 262 may include an infrared deviceand associated circuits and components, or a wireless bus protocolcompliant communication mechanism such as a Bluetooth® communicationmodule to provide for communication with similarly-enabled systems anddevices.

A predetermined set of applications that control basic deviceoperations, including data and voice communication applications willnormally be installed on the mobile device 201 during or aftermanufacture. Additional applications and/or upgrades to the operatingsystem 221 or software applications 225 may also be loaded onto themobile device 201 through the wireless network 101, the auxiliary I/Osubsystem 250, the serial port 252, the short-range communicationsubsystem 262, or other suitable subsystem 264. The downloaded programsor code modules may be permanently installed, for example, written intothe program memory (i.e. the flash memory 244), or written into andexecuted from the RAM 246 for execution by the processor 240 at runtime.Such flexibility in application installation increases the functionalityof the mobile device 201 and may provide enhanced on-device functions,communication-related functions, or both. For example, securecommunication applications may enable electronic commerce functions andother such financial transactions to be performed using the mobiledevice 201.

The mobile device 201 may provide two principal modes of communication:a data communication mode and a voice communication mode. In the datacommunication mode, a received data signal such as a text message, anemail message, or Web page download will be processed by thecommunication subsystem 211 and input to the processor 240 for furtherprocessing. For example, a downloaded Web page may be further processedby a browser application or an email message may be processed by theemail messaging application and output to the display 204. A user of themobile device 201 may also compose data items, such as email messages,for example, using the input devices in conjunction with the displayscreen 204. These composed items may be transmitted through thecommunication subsystem 211 over the wireless network 101.

In the voice communication mode, the mobile device 201 providestelephony functions and operates as a typical cellular phone. Theoverall operation is similar, except that the received signals areoutput to the speaker 256 and signals for transmission are generated bya transducer such as the microphone 258. The telephony functions areprovided by a combination of software/firmware (i.e., the phoneapplication 278) and hardware (i.e., the microphone 258, the speaker 256and input devices). Alternative voice or audio I/O subsystems, such as avoice message recording subsystem, may also be implemented on the mobiledevice 201. Although voice or audio signal output is typicallyaccomplished primarily through the speaker 256, the display screen 204may also be used to provide an indication of the identity of a callingparty, duration of a voice call, or other voice call relatedinformation.

The phone application 278 can be split into multiple applications orsub-modules, for example one or more user phone modules and a callcontrol module. The user phone modules provide a variety of telephonyfeatures through a user interface, while the call control moduleprovides access to common telephony functions desired by the user phonemodules, such that telephony requests from phone modules can becoordinated and so that the user phone modules do not need to eachprovide instructions understood by the wireless communications subsystem211. The call control function typically makes telephony featuresavailable to user phone modules through an application programminginterface (API). It is to be recognized that all or part of the phoneapplication 278 features or functions could be provided through theoperating system or otherwise distributed in the device 201, whilecontinuing to fall within the term phone application 278.

Referring now to FIG. 3, an exemplary computer readable media 310 willbe described. The computer readable media 310 have computer readableinstructions 320 stored thereon that when implemented cause a processor330 to execute any one of the methods described herein. For the purposesof the application, computer readable media comprise any tangiblecomputer storage, such as but not limited to flash memory, read onlymemory, CD, DVD and memory sticks. Graphical authentication module 280described above with reference to FIG. 2 is an exemplary implementationof computer readable media 310. However, it is to be understood that thecomputer readable media 310 is not limited to use on mobile devices,such as mobile device 210 described above. Non-limiting examples of theprocessor 330 include a CPU (central processing unit) on a personalcomputer, laptop computer, tablet device, personal digital assistant(PDA), mobile telephone, smart phone, bank machine, and digitalauthentication system for entry to rooms or buildings, or controlsystem. Any device with a processor, a display and a user interfaceenabling a user to move images on the display could feasibly make use ofthe computer readable media 310 to authenticate users.

A flow chart of a method implemented by the processor 330 is shown inFIG. 4 a. The method is a method of authenticating a user of a computingdevice, the computing device having a memory storing a base image and anoverlay image, the base image having a pre-selected base image referencepoint, and the overlay image having a pre-selected overlay imagereference point. The method starts with generating 410 a modified baseimage and generating 420 a modified overlay image. Then the methodcontinues with displaying 430, on a display, the modified base imageoverlaid by the modified overlay image. Action 440 of the method isreceiving a first input for moving one of the modified base image andthe modified overlay image. Then the method continues with moving 450the one of the modified base image and the modified overlay image inresponse to the input. Then at action 460, a second input is receivedindicating a level of pressure applied to a pressure sensitive inputdevice. A non-limiting example of a device that can detect the level ofpressure is one or more force sensing resistor (FSR). In someembodiments, several FSRs are mounted under the display and calibratedto the level of pressure required for the authentication process. Othernon-limiting examples of devices that can be used to detect the level ofpressure are piezo devices, such as piezo discs or plates. Theapplication of force causes bending of the piezo device which results inan electric charge, the level of which can be associated with the levelof pressure. In another non-limiting example, a capacitive touch screencan be used. In this embodiment, an increase in a touch contact areaindicates an increase in pressure. It is to be understood that thesecond input can be received before or after the first input. In someembodiments, the second input is received subsequent to alignment. Insome embodiments, the first input and the second input are part of onecontinuous action. For example, a user can move an image on a touchscreen by touching the screen and then apply pressure to the screenwithout lifting the finger used to move the image. Finally, at action470, in response to alignment of the base image reference point on themodified base image with the overlay image reference point on themodified overlay image at a point on the display and to an indication ofa correct level of pressure, positive authentication is indicated.Non-limiting examples of indicating positive authentication include:providing a visual indicator; providing an audible indicator; andallowing user access.

Referring now to FIG. 4 b, another example method will be described. Themethod in FIG. 4 b starts with actions 410, 420, 430, 440, 450, and 460from FIG. 4 a. Then, after receiving the second input, a determination465 is made of whether or not the base image reference point and theoverlay image reference point are aligned AND whether or not there is anindication of a correct level of pressure. If the determination is thatthere is alignment and that there is an indication of a correct level ofpressure, the method proceeds to action 470 which is the same as action470 in FIG. 4 a, that is indicating positive authentication. If there isno alignment or if there is no indication of the correct level ofpressure, the method proceeds to indicating 480 that authenticationfailed.

The indication that authentication failed in some embodiments is anaudio signal. In some embodiments, the indication that authenticationfailed is a visual output on the display. In some embodiments, ifauthentication failed, the method starts over. In some embodiments,after a set number of failed authentication attempts, a user is lockedout and not permitted to attempt authentication again. In someembodiments, the user is locked out until an administrator overrides thelock out. In other embodiments, the lock out is for a set time period.

In some embodiments the method further comprises timing theauthentication attempt. If positive authentication is not indicatedwithin a time limit, the method proceeds to action 480, i.e. indicatingthat authentication failed.

In some embodiments, the method further comprises displaying on thedisplay a pressure gauge showing the level of pressure applied. Anon-limiting example of such a pressure gauge 560 is shown in FIG. 5,where a display 530 is shown with a modified base image 730 displayedthereon as well. The pressure gauge 560 of the embodiment of FIG. 5 is abar chart, where the level pressure applied is represented by differentheights of the bars 562. The bars change colour to represent the levelof pressure applied. In other embodiments, a colour of part of the baseimage or overlay image or a background of the display changes inresponse to the level of pressure.

In some embodiments moving the one of the modified base image and themodified overlay image is also in response to meeting the pressurecriterion. Thus, there will be no movement in response to the firstinput unless the second input is at a correct level of pressure. In someembodiments, indicating positive authentication is also in response tomaintenance of the correct level of pressure during the moving.

Additionally, indicating positive authentication also can be in responseto detecting, after alignment, release of pressure at a specified rate.For example, a quick release may be required at the alignment point inorder to have positive authentication. Alternatively, in anotherembodiment, if the second input is independent of the movement, thecorrect pressure combined with a correct release rate is required forpositive authentication at or after alignment.

In non-limiting exemplary embodiments, the base image is a photograph ofa scene and the pre-selected reference point is an object or portion ofan object in the scene. In other non-limiting embodiments, the baseimage includes a plurality of abstract objects and the pre-selectedreference point is one of the abstract objects. In other embodiments,the base image is a grid of numbers, characters or objects.

In non-limiting embodiments, the overlay image is a grid of numbers,characters or objects. In some embodiments, the pre-selected number,character or object appears more than once in the grid. As with the baseimage, in some embodiments, the pre-selected image in some embodimentsis a photo or abstract image. In some cases, when the image is overlaidon the base image, it is presented so that the base image or portionsthereof are visible through the overlay image.

In some embodiments, one or both of the overlay image and the base imageis a 3-D image. In some embodiments, one or both of the overlay imageand the base image have data for three dimensions but are displayed on a2-D screen. Points in all three dimensions can be selected and movementwithin the three dimensions is possible in these embodiments. In someembodiments, the images are displayed on a 3-D screen.

In some embodiments, the reference point on either the base image oroverlay image or both is represented by a dot, an x or some other symbolnext to a recognizable part of the image, such as a number, character,or object. In some embodiments, the dot, x or other symbol appears nextto some or all other objects in the image. In some embodiments, thereference point is represented by a number, character or object in therespective image. In some embodiments, aligning the reference pointsincludes bringing one of the references points within a predefineddistance of the other reference point. In other words, there may be atolerance zone. The tolerance zone is an area around a reference pointin which a user selection will be interpreted as selection of thereference point. The tolerance zone can be made smaller for increasedsecurity or larger where less precision is possible. In someembodiments, the tolerance zone is variable and is made smaller whenincreased security is required. While the methods described withreference to FIGS. 4 a and 4 b refer to one base image and one overlayimage and a single reference point on each image, it is to be understoodthat any number of images and reference points can be used. It is to beunderstood that the methods described herein are not limited to theorder in which the actions are presented herein and that the variousactions may be implemented in a different order in other embodiments.

In some embodiments, there are two pre-selected overlay image referencepoints. To authenticate, the user must move a first overlay imagereference point to align with a first base image reference point andthen move the base image to align a second base image reference pointwith a second overlay image reference point. In embodiments, the firstand second base image reference points are the same.

In some example embodiments, the computer readable media 310 is locatedon the computing device. FIG. 6 shows a computing device 500 withcomputer readable media 310 installed thereon. The computing device 500also comprises a memory 510 on which the base image 511 and the overlayimage 521 are stored. Non-limiting examples of formats for storing thebase image 511 and the overlay image 521 are bitmap, PDF, JPEG, and PNG.In some embodiments, for example where a grid is used, the format of theimage can include different fonts or font technologies. In someembodiments, the memory 510 is an external memory, such as a memorystick or a memory on a server. A display 530 is also provided fordisplaying representations or modified versions of the base image 511and the overlay image 521. In some embodiments, the display is atouchscreen. In some cases, the touchscreen provides haptic feedbackthat is can assist the user in determining the level of pressure beingapplied. For example, the touchscreen may provide clicks or otherfeedback as the level of pressure increases. In a non-limiting example,the passcode requires a level of pressure that results in four clicks.Thus, the user can use the clicks as a guide to know when the correctlevel of pressure has been applied.

In some embodiments, one or both of the overlay image and the base imagestored in the memory comprise data or instructions for generating therespective image. For example, the stored image can compriseinstructions to generate a 2D grid of numbers from 1 to 100.

In some embodiments of the computer readable media 310, generating themodified base image comprises randomly altering the position of the baseimage reference point on the display. In some embodiments, the baseimage reference point is altered with respect to the rest of the baseimage. In other embodiments, generating the modified overlay imagecomprises randomly altering the position of the overlay image referencepoint. In some embodiments, both the base image reference point and theoverlay image reference point positions are altered.

In some embodiments, one or both of the overlay image and the base imageare distorted. Examples of distorting the image include but are notlimited to stretching the image (rubber band effect), blurring portionsof the image, compressing the image and morphing the image. Anotherexample involves generating a collage of images from the base image oroverlay image, where the collage can be reconfigured. In such anembodiment, in presenting the collage or modified image, the respectivereference points should be visible and not overlapped. In someembodiments, if the reference point is a number or character, the fontcan be changed.

In some embodiments, generating the modified base image comprises makinga copy of the base image. In some embodiments, the copy is an exactcopy. Likewise, in some embodiments, generating the modified overlayimage comprises making a copy of the overlay image and the copy of theoverlay image, in some cases, can be an exact copy of the overlay image.

Non-limiting examples of presenting the modified images includepresenting the respective image at a different location each time theinstructions are executed, distorting the appearance of the image androtating the modified image.

In some embodiments of the computer readable media 310, the inputcomprises a movement of the modified base image and a movement of themodified overlay image. The modified images are moved by the user usingnavigation controls on the computing device in some embodiments. Forexample, a mouse can be used to click and drag the image to be moved. Ifa touch screen is used, the user can touch and drag one or both images.Other non-limiting navigation controls include keys on a keyboard, atouchpad, a trackball, a thumbwheel and a joystick. In an exemplaryembodiment, the input comprises a sequence of movements of the baseimage and the overlay image. In some embodiments, the representations ofthe images must be moved in a specific sequence. For example, first moveone of the modified base image and the modified overlay image and thenmove the other of the two so that the respective reference points arealigned. In an exemplary embodiment, individual touch is used to moveboth planes, i.e. the base image plane and the overlay image plan. Insome embodiments, each plane can be moved simultaneously by a differentfinger if multi-touch input is supported. Some embodiments restrict themovement of each representation in horizontal, diagonal or verticaldirections.

In some embodiments, gestures are used to move the modified base imageor the modified overlay image or both. For example, pressure or anaccelerometer can control the movement.

Screen wrap can also be used in some embodiments to confuse third partyobservers. Screen wrap can be used in at least two manners. In thefirst, when part of the image moves off one edge of the display, thatpart appears immediately on the opposite side. In the first manner, theimage is usually the same size as the display. In the second manner,which is sometimes used when the image is larger than the display, partof the image moves off the edge but is not seen immediately on theopposite side. In this case, the third party observer would not see theentire image. In some such embodiments, one or more of the referencepoints may not be visible on the screen at first and the user has tomove the representation of the respective image to bring the referencepoint into view.

In one embodiment, the overlay image is a grid of numbers and when themodified overlay image is displayed, the grid could move up or down withonly a portion of the grid visible, i.e. higher or lower numbers may notbe visible. The user moves the grid to align the pre-selected numberwith the reference point on the modified base image. In someembodiments, the pre-selected number must be moved up or down to theproper height and then moved left or right to align with the referencepoint on the base image. The requirement to move a reference pointvertically and then horizontally or vice versa can be used in anyembodiment and is not limited to a grid of numbers.

Panoramic photos can also be used for either the base image or theoverlay image or both. In some such embodiments, the photo is moveableto align the reference points. In some embodiments, the photo ismoveable to align a point on the photo with a number on a grid. In someembodiments, the photo is moveable to align a point on the photo with acolumn and row in a grid corresponding to a pre-selected number. Inother embodiments, the photo is moveable left or right only. In otherembodiments, the photo is moveable up and down only.

In some embodiments, the overlay image is a grid of images andpresenting the modified overlay image comprises altering the position ofthe pre-selected overlay image reference point while maintaining atleast one of a column and a row with images having a commoncharacteristic. In an exemplary embodiment, the grid is a grid ofnumbers with all of the “x1s” in one column (1, 11, 21, etc.) and all ofthe “x2s” in another column (2, 12, 22, etc) and so on, but the positionof each number with the respective column changes each time theinstructions are executed. For example, if the grid is a grid of numbersand the pre-selected reference point on the overlay image is the number23, each time the grid is presented the reference point will be in adifferent row and column, but always in the same column as the “20s” andthe same row as the “x3s”. If the grid consists of shapes of varyingsizes, colours or other features, a feature (square shape, for example)could always be in the same column but the position in the column couldchange. Maintaining the reference point in a column or row with pointsof a common characteristic provides some assistance to the user infinding the reference point while maintaining the added security ofrandomly altering the location of the reference point.

In still another embodiment, the grid is randomly generated in responseto a user input, such as, but not limited to, a gesture, selecting akey, and a sequence of keystrokes. For example, with a device with anaccelerometer, shaking could reset the grid. In other embodiments, themodified base image or the modified overlay image or both could beprogrammed to reset after a predetermined period of time.

Referring to FIG. 7 a, a computing device 600 will be described. In someembodiments the computing device 600 is a mobile communications devicesuch as the mobile device 201 described herein. However, it is to beunderstood that the computing device 600 can be any computing device.Non-limiting examples include a personal computer, laptop computer,tablet device, personal digital assistant (PDA), mobile telephone, smartphone, bank machine, an access device for allowing access to a buildingor room, and an electronic controller for controlling systems orequipment.

The computing device 600 comprises the graphical computer readable media310, a display 620, and a processor 630. In some embodiments, the userinterface is a touch screen. The display 620 is used to display themodified base image and the modified overlay image. The processor 630for executing the instructions. In some embodiments, the computingdevice 600 also comprises the first memory and the second memory. Thecomputing device 600, in some embodiments also comprises a flash memoryon which the authentication module is located.

In some embodiments, the computing device 500 further comprises thepressure sensitive input device. An example of such a device is shown inFIG. 7 b, which is the same as FIG. 7 a with a pressure sensitive inputdevice 640 connected to the processor 630.

In an example embodiment, the pressure sensitive input device is atouchpad. In some embodiments, the pressure sensitive input deviceprovides haptic feedback indicating the level of pressure applied. In anon-limiting example, one or more piezo actuator is used to providehaptic feedback.

In some embodiments, the display comprises a touch screen and the firstinput is received via the touch screen. In an example implementation,the touch screen comprises the pressure sensitive input device.

In some embodiments, dedicated controls are provided on the computingdevice 600 for moving the representations of the base image or theoverlay image or both.

It is to be understood that the embodiments described herein are notlimited to one base image and one overlay image. Multiple layers ofimages are possible. Furthermore, multiple reference points on eachlayer are also possible.

Referring now to the screens shots of FIGS. 8 a to 8 d, a specificimplementation of a proposed method will be described. FIG. 8 a shows abase image 700, including a number of objects that can be selected as areference point: a tree, a flower, a person, a bird, a sun, and a cloud.In this example, the user has selected the flower 710 as the base imagereference point. In FIG. 8 b, an overlay image 720 which is a grid ofnumbers from 1 to 12 is shown. In this case, the user has selectednumber 8 as the overlay image reference point 722. In other embodiments,the grid need not be presented to the user to do the selection. Adialogue box can be presented asking the user to select a numberbetween, for example, 1 and 12. Referring to FIG. 8 c, to start theauthentication of the user, a modified base image 730 is presentedoverlaid with a modified overlay image 740. In modified base image 730,the position of the flower 710 has been altered. In some embodiments,the position of the base image reference point 710 varies with eachauthentication attempt. In modified overlay image 740, the order of thenumbers in the grid has been altered, so that the overlay referencepoint 722 is in a different position. It is to be understood that insome embodiments, the order of the numbers in the grid remains the sameand that the position of the overlay image reference point 722 mayremain the same while the position of the base image reference point 710varies. In some embodiments, the numbers can appear more than once inthe modified overlay image. Referring to FIG. 8 d, the user hassuccessfully completed the authentication by moving the modified overlayimage 740 so that the overlay image reference point 722 is aligned withthe base image reference point 710 and by applying the correct level ofpressure.

While the present disclosure is sometimes described in terms of methods,a person of ordinary skill in the art will understand that the presentdisclosure is also directed to various apparatus including componentsfor performing at least some of the aspects and features of thedescribed methods, be it by way of hardware components, software or anycombination of the two, or in any other manner. Moreover, an article ofmanufacture for use with the apparatus, such as a pre-recorded storagedevice or other similar computer readable medium including programinstructions recorded thereon may direct an apparatus to facilitate thepractice of the described methods. It is understood that such apparatusand articles of manufacture also come within the scope of the presentdisclosure.

The various embodiments presented above are merely examples and are inno way meant to limit the scope of this disclosure. Variations of theinnovations described herein will be apparent to persons of ordinaryskill in the art, such variations being within the intended scope of thepresent application. In particular, features from one or more of theabove-described embodiments may be selected to generate alternativeembodiments comprised of a sub-combination of features which may not beexplicitly described above. In addition, features from one or more ofthe above-described embodiments may be selected and combined to generatealternative embodiments comprised of a combination of features which maynot be explicitly described above. Features suitable for suchcombinations and sub-combinations would be readily apparent to personsskilled in the art upon review of the present application as a whole.The subject matter described herein and in the recited claims intends tocover and embrace all suitable changes in technology.

The invention claimed is:
 1. One or more non-transitory computerreadable media having computer readable instructions stored thereon forauthenticating a user of a computing device, the computing device havinga memory storing a base image and an overlay image, the base imagehaving a particular base image reference point, and the overlay imagehaving a particular overlay image reference point, the instructionscomprising: generating a modified base image, the modified base imageincluding a plurality of base image reference points and the particularbase image reference point; generating a modified overlay image, themodified overlay image including a plurality of overlay image referencepoints and the particular overlay image reference point; displaying, ona display, the modified base image overlaid by the modified overlayimage; receiving a first input for moving one of the modified base imageand the modified overlay image; moving the one of the modified baseimage and the modified overlay image in response to the input; receivinga second input indicative of pressure applied to a pressure sensitiveinput device; and in response to alignment of the particular base imagereference point on the modified base image with the particular overlayimage reference point on the modified overlay image at a point on thedisplay and to said second input meeting a pressure criterion,indicating positive authentication.
 2. The one or more computer readablemedia of claim 1, further comprising displaying on the display apressure gauge showing a level of pressure applied.
 3. The one or morecomputer readable media of claim 1, wherein displaying at least one ofthe modified base image and the modified overlay image is in response tomeeting the pressure criterion.
 4. The one or more computer readablemedia of claim 1, wherein indicating positive authentication is also inresponse to detecting, after alignment, release of pressure at aspecified rate.
 5. The one or more computer readable media of claim 1,wherein indicating positive authentication is also in response tomaintenance of a correct level of pressure during the moving.
 6. The oneor more computer readable media of claim 1, wherein the second input isreceived subsequent to alignment.
 7. A method of authenticating a userof a computing device, the computing device having a memory storing abase image and an overlay image, the base image having a particular baseimage reference point, and the overlay image having a particular overlayimage reference point, the method comprising: generating a modified baseimage, the modified base image including a plurality of base imagereference points and the particular base image reference point;generating a modified overlay image, the modified overlay imageincluding a plurality of overlay image reference points and theparticular overlay image reference point; displaying, on a display, themodified base image overlaid by the modified overlay image; receiving afirst input for moving one of the modified base image and the modifiedoverlay image; moving the one of the modified base image and themodified overlay image in response to the input; receiving a secondinput indicative of pressure applied to a pressure sensitive inputdevice; and in response to alignment of the particular base imagereference point on the modified base image with the particular overlayimage reference point on the modified overlay image at a point on thedisplay and to said second input meeting a pressure criterion,indicating positive authentication.
 8. The method of claim 7, whereindisplaying at least one of the modified base image and the modifiedoverlay image is in response to meeting the pressure criterion.
 9. Themethod of claim 7, wherein indicating positive authentication is also inresponse to detecting, after alignment, release of pressure at aspecified rate.
 10. The method of claim 7, wherein indicating positiveauthentication is also in response to maintenance of a correct level ofpressure during the moving.
 11. The method of claim 7, wherein thesecond input is received subsequent to alignment.
 12. The method ofclaim 7, further comprising displaying on the display a pressure gaugeshowing a level of pressure applied.
 13. A computing device comprising:a processor; a display; and one or more computer readable media havingcomputer readable instructions stored thereon for authenticating a userof the computing device, the computing device having a memory storing abase image and an overlay image, the base image having a particular baseimage reference point, and the overlay image having a particular overlayimage reference point, the instructions including generating a modifiedbase image, the modified base image including a plurality of base imagereference points and the particular base image reference point;generating a modified overlay image, the modified overlay imageincluding a plurality of overlay image reference points and theparticular overlay image reference point; displaying, on the display,the modified base image overlaid by the modified overlay image;receiving a first input for moving one of the modified base image andthe modified overlay image; moving the one of the modified base imageand the modified overlay image in response to the input; receiving asecond input indicative of pressure applied to a pressure sensitiveinput device; and in response to alignment of the particular base imagereference point on the modified base image with the particular overlayimage reference point on the modified overlay image at a point on thedisplay and to said second input meeting a pressure criterion,indicating positive authentication.
 14. The computing device of claim13, further comprising the memory.
 15. The computing device of claim 13,further comprising the pressure sensitive input device.
 16. Thecomputing device of claim 15, wherein the pressure sensitive inputdevice is a touchpad.
 17. The computing device of claim 15, wherein thepressure sensitive input device provides haptic feedback indicating thelevel of pressure applied.
 18. The computing device of claim 13, whereinthe display comprises a touch screen and the first input is received viathe touch screen.
 19. The computing device of claim 18, wherein thetouch screen comprises the pressure sensitive input device.
 20. Thecomputing device of claim 13, comprising a mobile electronic device.